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1. A method for controlling congestion in packet switched telecommunications 
networks, comprising: 

establishing a queue to buffer packets for transmission on a telecommunications 

link; 

determining, on the basis of at least the packets placed in said queue, whether a 
user associated with a packet to be placed in said queue has utilised an allowed capacity 
for said link; and 

discarding said packet if said allowed capacity has been utilised. 
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A METHOD FOR CONTROLLING CONGESTION IN 
PACKET SWITCHED TELECOMMUNICATIONS NETWORKS 

5 

The present invention relates to a method for controlling congestion in packet 
switched telecommunications networks. 

Congestion in packet switched telecommunications networks, such as 
10 asynchronous time division multiplexing (ATM) networks, occurs when capacitv 
allocations for users are exceeded and telecommunications links between users arc 
overloaded with excess packets. In an overload situation, which may occur at the output 
pons or links of a packet switch, excess packets are simply discarded on a random basis. 
Protocols are available to users who wish to recover discarded packets but most of these 
1 5 protocols simply retransmit previously received packets, in addition to the packets which 
have been discarded. Retransmission of successfully received packets exacerbates the 
overload condition, is a waste of network capacity and gives rise to a situation known as 
congestion collapse. A severe form of congestion collapse occurs when the available link 
capacity is less than the average traffic offered for transmission on the link and is known 
:<> .is self sustaining congestion collapse. For satisfactory network performance, self 
sustaining congestion collapse must be prevented or confined to only occur as a rare 



>0 



event. 



Users of the network need to be encouraged to use protocols, known as adaptive 
protocols, which prevent overload conditions. Adaptive protocols arc able to detect when 
overload is imminent and reduce the amount of traffic offered on a link. The network 
therefore needs to be configured so as to encourage fair use of network capacity and 
discourage excessive use, such as by unnecessary retransmission of packets. 

The term "user" is used throughout the present specification to refer to the 
telecommunications connection or traffic stream established by a call, the party which is 
the originator of the call and/or the party which is the receiver of the call. 
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One method for controlling congestion is known as fairness queuing which 
involves implementing a queue for each user of a link at the output ports of a fast packet 
switch. The queues arc served consecutively and, as described hereinafter, packets arc 
automatically discarded when a user's respective queue is full, which would occur during 
5 excessive use by the user of the link. Fairness queuing, however, is expensive to 
implement in high speed packet switched networks as a separate queue needs to exist for 
each user of each network link. The requirement for a separate queue is particularly 
onerous in ATM networks where the queues have to be implemented in hardware. 

10 An object of the present invention is to overcome, at least in part, the problems 

associated with fairness queuing. 

In accordance with the present invention there is provided a method for 
controlling congestion in packet switched telecommunications networks, comprising: 
15 establishing a queue to buffer packets for transmission on a telecommunications 

link; 

determining, on the basis of at least the packets placed in said queue, whether a 
user associated with a packet to be placed in said queue has utilised an allowed capacity 
for said link; and 

20 discarding said packet if said allowed capacity has been utilised. 

Preferably the link is an output link of a packet switch of said network. 

Preferably said allowed capacity has been utilised if the number of packets 
25 associated with said user in said queue is greater than or equal to the number of empty 
packet locations in said queue. 

Preferably said allowed capacity has been utilised if said queue is almost full and 
the number of packets transmitted on said link associated with said user will exceed the 
30 average number of packets placed in said queue per user since the queue was empty if 
said packet is placed in said queue. 
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Preferably the method includes determining a fair packet transmission share, and 
wherein said allowed capacity is determined as having been utilised when said share has 
been exceeded by said user associated with said packet. 

5 Preferred embodiments of the present invention are hereinafter described, by way 

of example only, with reference to the accompanying drawings, wherein: 

Figure 1 is a schematic diagram illustrating the fairness queuing protocol; 
Figure 2 is a schematic diagram of an output port of a fast packet switch using 
a preferred embodiment of a fairness discarding protocol; and 
10 Figure 3 is a graph of a packet count list maintained for a preferred embodiment 

of the fairness discarding protocol. 

Fast packet switches for telecommunications networks may be implemented using 
a number of different configurations. The switches may be controlled primarily by 

15 software, such as described in "Stochastic Fairness Queuing", P.E. McKcnncy, 
Internetworking: Research and Experience, Vol. 2, Pages 113 to 131, 1991, or as in an 
ATM network which meets B-ISDN standards, the switches may be implemented 
primarily in hardware, such as described in "The Application of Multistage 
Interconnection Networks to Fast Packet Switching", R. Palmer, C. O'Neill and 

20 E. Tirtaatmadja, Journal of Electrical and Electronics Engineering, Australia. Vol. 8, 
No. 2, Pages 119 to 129, June 1988. The switches all include processing and data 
storage capabilities which can be adjusted to alter the packet switching and transmission 
protocols executed by the switches. 

25 The fairness queuing protocol is implemented at each output port of a fast packet 

switch to avoid congestion of packets routed by the switch to a link. Packets 10 received 
by an output port 2, as shown in Figure 1, are first processed by a distributor 4 on the 
basis of the signalling information contained in the packets 10 so as to allocate each 
packet to a user and to a respective output queue 6 of the port 2. The queues 6 arc "first 

30 come first serve" queues and one is provided for each user of the port 2. The queues 6 
receive packets from the distributor 4 and output the packets on the output link 8 of the 
port 2 one at a time on a sequential basis. The queues 6 arc polled for the release of a 
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packet in a round robin manner. The sizes of the queue 6 are finite and the queue 6 will 
begin to fill if a user begins transmitting on the link 8 at a rate which is excessive. If 
a user is transmitting at a rate which is greater than the user's fair share of the link's 
capacity, once the user's queue 6 is full, packets associated with the user will begin to be 
5 discarded. The fair share is determined by the size of the respective queue 6 and the rate 
at which it is served. 

Therefore as the queues 6 are implemented on a user basis, the fairness queuing 
method penalises users who choose to exceed their share of a network link's capacity. 

10 This fair loss of packets also minimises the effect of overload conditions on users who 
do not exceed their fair share of capacity and implement adaptive protocols. Fairness 
queuing allows users to adopt communications protocols which will enable them to 
achieve transmission at the highest rate that will still avoid loss of packets from the 
queues 6. However, as discussed previously, fairness queuing requires a queue 6 to be 

15 implemented for each user of each network link which is expensive, prohibitively so for 
ATM networks. 

Accordingly, a new method for relieving congestion on a network link has been 
developed which is described hereinafter and referred to as fairness discarding. 

20 

An output port 12 of a fast packet switch, as sho\wi in Figure 2, is provided with 
a "first come first serve" queue 14 which receives packets from a discarder 16. Packets 
served from the queue 14 arc outputtcd from the port 12 on an output link 8. All packets 
of different users destined for the output link 8, and belonging to a particular priority 

25 level, arc queued in one queue 14. The discarder 16 receives packets 10 sent to the port 
12 and determines whether they should be discarded or placed in the queue 14 on the 
basis of a record 18 which is maintained of packets transmitted and held in the queue 14. 
On the basis of the record 18, the discarder 16 is able to discard packets associated with 
a user when it has determined the user has already received a fair share of the output 

30 link's capacity. This provides fair sharing of the link's capacity when overload occurs and 
motivation for users to adopt protocols which alleviate congestion. 
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The decision to discard or queue a packet made by the discarder 16 may be a 
function of any variables that are related to the history of packet transmission by the user 
associated with the packet and, preferably the history of packet transmission from all 
users. Variables can include the number of packets from each user that are held in the 

5 queue 14. the amount of spare buffer space in the queue 14 or a count of the packets 
which have been sent by each user over a predetermined period of time. The procedures 
used by the discarder 16, which dictate the records 18 that are maintained, can be 
classified according to whether they rely just on information associated with the packets 
held in the queue 14 at the time a new packet is received by the discarder 16, "basic 
10 information procedures", or whether they also rely upon information related to packets 
that have been transmitted and arc no longer held in the queue 14, "additional information 
procedures". The later type of procedure is preferably used when the queue 14 is small, 
whereas the larger the size of the queue 14, the more information is available and then 
the basic information procedures arc satisfactory. Additional information procedures arc. 

1 5 in most cases, more complex than basic information procedures. 

A preferred basic information procedure is if a packet received by the discarder 
16 belongs to a user which has fewer packets held in the queue or buffer 14 than the 
number of spare buffer places in the queue 14 then the packet is buffered, and 
20 subsequently transmitted, otherwise it is discarded by the discarder 16. The discarder 16 
uses the signalling information contained in the packets 10 to determine Which user and 
connection stream a packet belongs to, and on transmission to the queue 14. the packet 
record 18 is updated to correctly reflect the numbers of packets in the queue 14 for each 
user. 

25 

If there is only one user using the output link 8 then the user will be able to 
utilise nearly half of the queue 14 without having any packets discarded by the discarder 
16. and this is normally an adequate amount of buffer space. If the user overloads the 
link 8 then packets are discarded once the queue 14 is half filled. 



30 



When the link 8 is overloaded and the queue 14 has only one spare space 
remaining, the only packet that may be queued is one that belongs to a user who docs not 
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already have any packets in the queue 14. The queue 14 will be nearly full most of the 
time when the link is overloaded. For example, if the queue 14 can hold 98 packets, 
there arc ten active users, and each user has nine packets in the queue 14, giving a total 
of ninety packets, then there is only eight spare spaces in the queue 14 and a user is only 

5 allowed to put another packet in the queue when it has less than eight packets stored 
therein. Therefore no active user is presently allowed to queue any more packets. Once 
the oldest packet has been served from the head of the queue 14, the user associated with 
the packet now has eight packets queued and the queue 14 has nine spare buffer spaces. 
Therefore that user is allowed to put another packet in the buffer but none of the other 

10 users can. Provided users supply packets to the queue whenever spaces arc available for 
them, packets for each user arc sequentially buffered in the queue in a cyclical manner. 
The average packet transmission rate for each user is proportional to the number of 
packets that each user has in the queue 4, and as each user effectively has the same 
number of packets in the queue 14 whenever a packet is transmitted, they each achieve 

15 the same packet transmission rate. This occurs even if each user attempts to exceed a 
fair share of capacity, thus fair sharing of capacity of the overloaded link is enforced. 

Assuming again each one of ten users has nine packets in the same 98 packet 
queue, but instead one user acts to minimise congestion collapse by transmitting packets 

20 at a constant rate which is just slower than a fair share of link capacity, then at some 
stage the packet of the constant rate user would be released by the queue 14 and another 
packet will also be released without the spare spaces being used. Whe'n this occurs there 
will be ten spare buffer places in the queue 14 and any user can then put another packet 
in the queue. Assuming one of the users that already has nine packets utilises one of the 

25 spare spaces, then that user will have ten packets in the queue. Nine spare buffer spaces 
then exist and the user who had a packet served after the constant rate user is able to 
utilise one of the spaces as that user only has eight packets queued. Assuming this user 
utilises the available space, the queue 14 will have eight users with nine packets queued, 
one user with ten packets queued, the constant rate user with eight packets queued and 

- ; n eight spare buffer places. The constant rate user is now unable to queue another packet 
in the queue 14 and its packets will be discarded. This is a worse case situation which 
can occur but when the constant rate user has a packet served it then has seven packets 
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in the buffer and there are nine spare buffer spaces. Then even if one of the other user's 
packets are served before the next packet of the constant rate user arrives, and a packet 
of the other user's is queued, the constant rate user is always able to queue its next packet 
and have eight packets queued. The constant rate user is therefore guaranteed eight 

5 packets in the queue at all times, which gives rise to a guaranteed throughput of 8/90 of 
the capacity of the output link 8, 90 being the steady state number of packets queued. 
As there arc ten active users, this represents 8/9 of a fair share of the link capacity 10. 
A measure of fairness, F, can be defined for such worse case situations where a constant 
rate user is transmitting on a link with users who transmit at the highest successful rate, 

10 and is given by the following equation: 



15 



n x int [(b +l-n u )/(n u +l)] 



(1) 



b ♦ 1 - int [(b-2)/(n u +l)] 

where n u is the number of users, b is the packet length of the queue 14, and int refers to 
an integer function which truncates any remainders. 

Fairness, F, declines with a decreasing buffer size and an increasing number of 
active users. If the number of active users exceeds half the queue size then fairness is 
zero, whereas if the buffer size is just greater than double the number of active users, 
fairness is 0.5. To improve fairness in these situations additional information procedures 
can be used by the discarder 16 but in practice, the procedures may not be required as 
sufficiently large queues may be implemented so the queue size nearly always 
20 substantially exceeds double the number of active users of the link 8. 



A preferred additional information procedure is if the queue 14 is nearly full then 
packets associated with a user arc discarded if the user has had nearly the average 
number of packets accepted for transmission over the period of time since the queue 14 
25 was last empty. Nearly the average number of packets means if another packet is 
accepted for transmission then, after accepting the packet, more than the average would 
have been accepted for the user. The procedure requires the discarder 16 to maintain and 
update the average number of packets accepted for transmission by continually dividing 
the number of accepted packets by the number of active users, maintaining a tally of the 
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packets accepted for transmission for each user, and determining what the average will 
be if a packet is accepted. The procedure effectively decides how full the queue 14 can 
be before packets are discarded. 

5 If only one user is using the queue 14 and the link 8, the user will be able to fill 

the buffer as the user will never exceed the new average number of accepted 
transmissions when a packet is accepted for queuing in the queue 14. Packets will be 
discarded when the user overloads the link 8 and fills the queue 14. 

10 When the link 8 is overloaded by a number of users, packets will only be accepted 

which belong to users or streams that are transmitting at less than the average packet rate 
per user. In the overload condition, the queue 14 will be nearly full most of the time. 

The additional information procedure may be implemented when a certain number 
15 of spaces in the queue have been used, as the procedure is primarily required when 
overload is imminent. For example, if the queue 14 holds ten packets and there arc ten 
active users, then the procedure may be implemented only after five packets have been 
queued. At any instant each user will be able to have some number of packets accepted 
for queuing and transmission. Users who have fewer than the average number of packets 
20 accepted will be able to use any of the spaces in the queue 14 but users who have had 
more than the average number of packets accepted can only use the first five available 
spaces before the procedure is used by the discarder 16. 

In a situation where one user sends packets at a constant rate and all the other 
25 users queue packets as fast as possible, the user sending at the rate which is just less than 
iis fair share, i.e. less than the average number of packets transmitted, will have all 
packets accepted and transmitted. The other users will share the remaining capacity, but 
there is not guarantee the remaining capacity will be shared fairly. The other users arc 
only guaranteed to obtain the average accepted number of transmissions for all users. 
30 Nevertheless, users will be sufficiently motivated to implement adaptive protocols that 
control congestion. 
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- " To achieve optimum fairness, a fair packet discarding procedure can be used, 

which involves the discarder lft keeping a list of the number of packets belonging to each 
streum that have been accepted and arrived at the queue 14 since it was last empty. The 
list is arranged in order of numbers of packets for each stream. When packets were 

5 added to the queue 14 or released therefrom, the list is updated, if necessary. The 
procedure determines which packet streams have sent more packets to the link 8 than a 
fair share. Packets received by the discarder 16 that belong to streams which have 
exceeded their fair share are discarded. The procedure, as described hereinafter, 
determines what constitutes a fair share on the basis of the maintained list of packets. 

10 

For example, Figure 3 illustrates a graph 24 of the number of packets which have 
been received on an output port 2 for eight streams since the queue 14 was last empty. 
The vertical axis 19 represents the number of packets received by the port 2 and the 
horizontal axis 21 represents, the number allocated to each of the streams. The graph 24 

15 represents the information maintained in the record 18. Assuming there are six packets 
queued, this means that six packets in excess of the transmission capacity of the link have 
arrived since the last time the queue was empty and have therefore been queued. The 
excess, bounded by the dotted lines 20 and 22 in the graph 24, may be considered to 
have been produced by streams 1, 2, 3 and 4, 2.75 from stream 1, 1.75 from stream 2, 

20 and 0.75 from each of the streams 3 and 4. The fair share, as indicated by the dotted line 
26, for each stream can be arbitrarily determined to be that which, if exceeded, would 
cause more than four packets to be queued. In other words, if the streams had only 
transmitted their fair share of capacity then there would only be four packets queued. 
Therefore streams 1 and 2 have exceeded their fair share by 1 5 and 0.5 packets 

25 respectively, and are marked so that any new packets received from the streams are 
discarded. Packets from streams 1 and 2 are discarded until the fair share value increases 
so as to be above the number of packets that have been received and accepted and 
queued for transmission for the streams. 

30 The fair share value is incrementally calculated when a new packet is added to 

the queue 14 or when a packet is served from the queue. The new fair share value 
S((new) is advantageously calculated from the old fair share value S t (old), as described 
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hereinafter, and the values may be real values, not just integers. 

When a new packet is added to the queue 14, the maintained count of packets that 
have beer; accepted on its stream is increased by one and: 

S/new) = S/old) - 1/N X (2) 

5 if N, > 0 where N x is the number of streams previously exceeding the fair share value. 
If N, = 0: 

S/new) = S,<old) f3) 

The above is valid provided S,<ncw) is greater than S u , which is the number of 
accepted packets for the stream which has the greatest number of packets after the 
streams of the graph 24 that exceed S^old). If this is not the case, then the new fair 
10 share value is given by: 

S^new) = S In - (1 - (S/olcD-SJN^/CN^l) (4) 

Again, equation 4 is only valid as long as S,(ncw) is greater than which is the 
number of packets in the stream which has the greatest number of packets after the 
stream with S ln packets. If equation 4 is not valid, then the new fair share is given by: 

S^new) = - (1 - (S,<old)-S ln )N x - (S ln -S 2n )(N x + l))/CN I+ 2) (5) 

Similarly, equation 5 is valid only if Sj(ncw) is greater than S ?n , being the number 
15 of packets in the stream with the next greatest number of packets after the stream with 
S, n packets. If equation 5 is not valid, then the next equation for S ( (ncw) can be 
determined recursively from equations 2 to 5. A stream is marked to have additional 
packets which arrive discarded when the number of packets it has already had accepted 
for transmission is greater than S((new). 



20 



As discussed above, the maintained count of packets of a stream is increased by 
one when a packet for the stream is added to the queue 14, and the record of counts of 
packets is reordered if the new count now exceeds a previously smaller count of packets 
for another stream. If the new count exceeds S^oid) then equations 2 to 5 do not apply 
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and the new fair share value is given by: 

S^new) = S/old) - (S^old)-S J/(N X +1) (6) 

The right hand side of equation 6, after some manipulation, is the same as the 
right hand side of equation 4 except for the term -1/(N X +1). Therefore equation 6 can 
be replaced by equation 4 when the. newly received packet is added to the count S ln 
before using equation 4 to determine S^new). 

When a packet is removed from the queue 14 and placed on the output link 8, the 
new fair share value is given by: 

S^nev/) = S^old) ♦ l/max(N x ,l) (7) 

where max( ) is the maximum of the arguments. Equation 7 is valid provided S((new) 
is less than S lg which is the number of packets on the stream having the least number of 
packets that exceed S,(old). If equation 7 is not valid then: 

S/new) = S lg * (1 - (S^-S/oldMNJ/CN^l) (8) 

Equation 8 is only valid if S,(ncw) is less than S^, which is the number of packets 
on the stream having the least number of packets greater than S lg . If equation 8 is not 
valid then: 

S^new) = S 2g * (1 - (S lg -S f (old))N i - (S 2g -S lg )(N x -l))/(N x -2) (9) 

Similarly, equation 9 is only valid if S^ncw) is less than S 3g , which is the number 
of packets on the stream having the least number of packets greater than S 2g . When 
equation 9 is not valid, the next equation for S,(ncw) can be developed recursively from 
equations 7 to 9. 

Equations 2 to 6 decrease the fair share value when a packet is added to the queue 
14 and ensure the value is decreased in an inverse proportion with respect to the number 
of streams which will now exceed or equal the fair share value, i.e. the decrease is shared 
amongst those streams. Similarly, equations 7 to 9 increase the fair share value when a 
packet is served from the queue 14 by such an amount so that the increase is in an 
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inverse proportion with respect to the number of streams that now exceed the fair share 
value, i.e. the increase is shared amongst those streams. 

The count of packets for each stream is continually maintained and incremented, 
5 even when packets are removed from the queue 14, and the counts are only reset to zero 
when the queue 14 becomes empty. The initial value for the fair share value is 
preferably somewhere near the size of the queue 14 so as to allow for large bursts of 
traffic without unnecessarily discarding packets which do not give rise to a high risk of 
overflow from the queue 14. For example, if the buffer size is seven packets, the initial 
10 value for the fair share may be set at five packets. 

If desired, depending on traffic requirements, the discardcr can be. configured so 
traffic is shared unevenly by users. This can be achieved by introducing selected factors 
into variables of the procedures used by the discardcr which arc associated with each 
1 5 user. 



9yY> 1 7.p : \opcr\dbw J»LJ02S.9Z 1 3 




14 - . 

THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS: 

1. A method for controlling congestion in packet switched telecommunications 
networks, comprising: 

5 establishing a queue to buffer packets for transmission on a telecommunications 

link; 

determining, on the basis of at least the packets placed in said queue, whether a 
user associated with a packet to be placed in said queue has utilised an allowed capacity 
for said link; and 

10 discarding said packet if said allowed capacity has been utilised. 

2. A method as claimed in claim l t wherein the link is an output link of a packet 
switch of said network. . 

15 3. A method as claimed in claim 1 or 2, wherein said basis of said determining step 
includes the number of empty packet locations in said queue. 

4. A method as claimed in any one of the preceding claims, wherein said basis of 
said determining step includes the number of packets transmitted on said link. 

20 

5. A method as claimed in claim 1, 2 or 3, wherein said basis of said determining 
step includes the number of packets transmitted on said link by each user of said link. 

ft. A method as claimed in any one of the preceding claims, wherein said basis of 
25 said determining step includes the number of packets each user of said link has in said 
queue. 

7. A method as claimed in claim 1 or 2, wherein said determining step determines 
said allowed capacity has been utilised if the number of packets associated with said user 
30 in said queue is greater than or equal to the number of empty packet locations in said 
queue. 



9306 1 7.p:\opcrMbw J>L302S .9Z 1 4 



10 



- 15 - 

8. A method as claimed in any one of the preceding claims, wherein said 
determining step determines said allowed capacity has been utilised if said queue is 
almost full and the number of packets transmitted on said link associated with said user 
will exceed the average number of packets placed in said queue per user since the queue 
was empty if said packet is placed in said queue. 

9. A method as claimed in claim 8, wherein said average is the number of packets 
placed in said queue since said queue was empty divided by the number of users of said 
link. 

10. A method as claimed in any one of the preceding claims, including determining 
a fair packet transmission share, and wherein said allowed capacity is determined as 
having been utilised when said fair packet transmission share has been exceeded by said 
user associated with said packet. 



11. A method as claimed in any one of claims 1 to 9, including: 

maintaining a record of the number of packets each user of said link has placed 
in said queue; 

determining a number of packets comprising a fair packet transmission share, 
20 based on said record; and 

determining said allowed capacity as having been exceeded when said user 
exceeds said fair transmission share. 

12. A method as claimed in claim 11, wherein said fair transmission share is adjusted 
2^ when a packet is placed in said queue and when a packet is served from said queue. 

13. A method as claimed in claim 11, wherein said fair transmission share is 
decreased when a packet is placed in said queue and increased when a packet is served 
from said queue. 



30 



14. A method as claimed in any one of claims 10 to 13, wherein said fair transmission 
share is set so that if exceeded then more than a predetermined number of packets would 
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„ * be held in said queue. 

15. A method for controlling congestion in packet switched telecommunications 
networks substantially as hereinbefore described with reference to the accompanying 

5 drawings. 

16. The steps, features, compositions and compounds disclosed herein or referred to 
or indicated in the specification and/or claims of this application, individually or 
collectively, and any and all combinations or any two or more of said steps or features. 

10 



15 

DATED this 17th day of June, 1993 

TELSTRA CORPORATION LIMITED 
By its Patent Attorneys 
20 DAVFES COLLISON CAVE 
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ABSTRACT 



A method for controlling congestion in packet switched telecommunications 
networks, comprising establishing a queue (14) to buffer packets for transmission on a 
telecommunications link (8), determining, on the basis of at least the pa :kcts placed in 
the queue (14), whether a user associated with a packet to be placed in the queue (14) 
has utilised an allowed capacity for the link (8), and discarding the packet if the allowed 
capacity has been utilised. 
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